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Stochastic solutions not only provide new rigorous results for non- 
linear pde's but also, through its local non-grid nature, are a natural 
tool for parallel computation. 

There are two methods to construct stochastic solutions: the McK- 
ean method and superprocesses. Here a comparison is made of these 
two approaches and their strenghts and limitations are discussed. 

1 Introduction: Stochastic solutions and their 
uses 

A stochastic solution of a linear or nonlinear partial differential equation is a 
stochastic process which, when started from a particular point in the domain 
generates after a time t a boundary measure which, when integrated over the 
initial condition at t = 0, provides the solution at the point x and time t. 
For example for the heat equation 
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with 




(1) 



the stochastic process is Brownian motion and the solution is 



u{t,x) =EJ{Xt) 



(2) 



meaning the expectation vahie, starting from x, of the process 



dXt = dBt 



(3) 



The domain here is M x [0,t) and the expectation value in ([2]) is indeed the 
inner product (yUf, /) of the initial condition / with the measure generated 
by the Brownian motion at the t— boundary. The usual integral solution, 



with the heat kernel, has exactly the same interpretation. Of course, an 
important condition for the stochastic process (Brownian motion in this case) 
to be considered the solution of the equation is the fact that the same process 
works for any initial condition. This should be contrasted with stochastic 
processes constructed from particular solutions. 

That the solutions of linear elliptic and parabolic equations, both with 
Cauchy and Dirichlet boundary conditions, have a probabilistic interpre- 
tation is a classical result and a standard tool in potential theory [1] [2] 
[3]. In contrast with the linear problems, explicit solutions in terms of ele- 
mentary functions or integrals for nonlinear partial differential equations are 
only known in very particular cases. Therefore the construction of solutions 
through stochastic processes, for nonlinear equations, has become an active 
field in recent years. The first stochastic solution for a nonlinear pde was 
constructed by McKean [4] for the KPP equation. Later on, the exit mea- 
sures provided by diffusion plus branching processes [5] [H] as well as the 
stochastic representations recently constructed for the Navier-Stokes [7] [8] 
i] [10] [m, the Vlasov-Poisson [12] [I3] [I5], the Euler [H] and a fractional 
version of the KPP equation [16] define solution-independent processes for 
which the mean values of some functionals are solutions to these equations. 
Therefore, they are exact stochastic solutions. 

In the stochastic solutions one deals with a process that starts from the 
point where the solution is to be found, a functional being then computed 
on the boundary or in some cases along the whole sample path. In addition 
to providing new exact results, the stochastic solutions are also a promising 
tool for numerical implementation. This is because: 
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(i) Deterministic algorithms grow exponentially with the dimension d of 
the space , roughly A^*^ (-^ being the linear size of the grid). This implies 
that to have reasonable computing times, the number of grid points may not 
be sufficient to obtain a good local resolution for the solution. In contrast a 
stochastic simulation only grows with the dimension of the process, typically 
of order d. 

(ii) In general, deterministic algorithms aim at obtaining the global be- 
havior of the solution in the whole domain. That means that even if an 
efficient deterministic algorithm exists for the problem, a stochastic algo- 
rithm might still be competitive if only localized values of the solution are 
desired. This comes from the very nature of the stochastic representation 
processes that always start from a definite point of the domain. According 
to what is desired, real or Fourier space representations should be used. For 
example by studying only a few high Fourier modes one may obtain informa- 
tion on the small scale fluctuations that only a very fine grid would provide 
in a deterministic algorithm. 

(iii) Each time a sample path of the process is implemented, it is indepen- 
dent from any other sample paths that are used to obtain the expectation 
value. Likewise, paths starting from different points are independent from 
each other. Therefore the stochastic algorithms are a natural choice for par- 
allel and distributed implementation. Provided some differentiability condi- 
tions are satisfled, the process also handles equally well simple or complex 
boundary conditions. 

(iv) Stochastic algorithms may also be used for domain decomposition 
purposes [T7j [18] [19]. One may, for example, decompose the space in sub- 
domains and then use in each one a deterministic algorithm with Dirichlet 
boundary conditions, the values on the boundaries being determined by a 
stochastic algorithm, thus minimizing the time-consuming communication 
problem between domains. 

There are basically two methods to construct stochastic solutions. The 
flrst method, which will be called the McKean method, is essentially a prob- 
abilistic interpretation of the Picard series. The differential equation is writ- 
ten as an integral equation which is rearranged in a such a way that the 
coefficients of the successive terms in the Picard iteration obey a normaliza- 
tion condition. The Picard iteration is then interpreted as an evolution and 
branching process, the stochastic solution being equivalent to importance 
sampling of the normalized Picard series. The second method constructs the 
boundary measures of a measure-valued stochastic process (a superprocess) 
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and obtain the solutions of the differential equation by a scaling procedure. 

In this paper the two methods are compared and in the final sections one 
shows how the superprocess construction may be extended to larger classes of 
partial differential equations by going from process on measures to processes 
on signed measures and processes on distributions. 



2 McKean and superprocesses: The KPP equa- 
tion 

2.1 The KPP equation: McKean's formulation 

To illustrate the two methods for the construction of stochastic solutions a 
classical example will be used, namely the KPP equation |4J 

dv 1 d'^v 2 

with initial data v (0, x) = g (x) 

Let G(t,x) be the Green's operator for the heat equation dtv{t,x) = 
l&<t,x) 

G (t, x) = e^*^ (6) 
Then the equation in integral form is 

v{t,x) = e-'G{t,x)g{x) + [ e-^'-'^'G {t - s,x) v"^ {s,x) ds (7) 



Denoting by (^f , Ila;) a Brownian motion started from time zero and coordi- 
nate X, Eq.(I7]) may be rewritten 



(8) 



Therefore the solution is obtained by the following process: 

At the initial time, a single particle begins a Brownian motion, starting 
from X and continuing for an exponential holding time T with P {T > t) = 
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Then, at T, the particle splits into two, the new particles continuing along 
independent Brownian paths starting from x{T). These particles, in turn, 
are subjected to the same splitting rule, meaning that after an elapsed time 
t > one has n particles located at xi (t) , X2 (t) , ■ ■ ■ x„ (t) with P {n = k) = 
e'* (1 - e-'f-\ 

The solution of ([7]) is obtained by 

v{t,x)=¥.{g{xi(t))g{x2{t))---g{xn{t))} (9) 



^ x2(t) 



* x3(t) 



^ x4(t) 



-0 x5(t) 



x6(t) 



Figure 1: The McKean process for the KPP equation 

An equivalent interpretation consists in considering the process propagat- 
ing backwards in time from time t at the point x and, when it reaches time 
zero, it samples the initial condition. That is, the process generates a measure 
at the if: = boundary which is then applied to the function g (x) = v {0,x). 

This construction, which expresses the solution as a stochastic multi- 
plicative functional of the initial condition, is also qualitatively equivalent to 
importance sampling of the Picard iteration of Eq.Q. 

A sufficient condition for the existence of (Q is |5'(a;)| < 1 or, almost 
surely, \g {x) \ (1 — e~*) < 1. 

Another probabilistic approach to this type of equations is through the 
construction of superprocesses. In many cases a superprocess may be looked 
at as the scaling limit of a branching particle system. The point of view used 
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in the derivation of superprocesses is different from the derivation above. In 
the next subsection a short introduction to superprocesses is sketched and 
then the KPP solution is constructed via superprocesses. 

2.2 Branching exit measures and superprocesses 

Let {E, B) be a measurable space and M_|_ {E) the space of finite measures 
in E. Denote by (X(,Po,m) ^ branching stochastic process with values in 
M+ {E) and transition probability Po.m starting from time and measure ix. 
The process is said to satisfy the branching property if given = fii + 

Po,, = Po,^,*Po,,, (10) 

that is, after the branching (X^^Pq.mi) i-^t ^ Po ,fj.2) independent and 
Xl + has the same law as {Xf, Pro^^). In terms of the transition operator 
Vt operating on functions on E this is 

Vtf ifii + /is) = VJ (/ii) + VJ (/X2) (11) 

where e'^^'^'''^ = P^,^e-<-^'^*> or 

\4/(/x) = -logPo,^e-<^'^*> (12) 

Vt is called the log-Laplace semigroup associated to Xt. In f|T2l) if the initial 
measure fi is 6^ one writes 

\4/(x) = -logPo,.e-<^'^*> (13) 

By (11 01) the probability law of X^ is infinitely divisible. 

Now in 5 = [0, oo) x E consider a set Q C 5 and the associated branching 
exit process {Xq,P^) composed of a propagating Markov process in E, 
^ = (^t,no,a;), a set of probabilities Pn{t,x) describing the branching and a 
parameter k defining the lifetime. 

u{x) = Vgfix) = -logPo,.e-(^'^'?) (14) 

(/, Xq) is the integral of the function / on the (space-time) boundary with 
the boundary exit measure generated by the process. One says that this 
branching exit process is a (^, ip) —superprocess if u {x) satisfies the equation 

u + GQi;{u) = KQf (15) 
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where Gq is the Green operator, 

Gq/ {r,x) = Uo,^ f{s,Qds 
Jo 

Kq the Poisson operator 



(16) 



(17) 



(u) means ip (0, x; u (0, x)) and r is the exit time from Q. 
The superprocess is constructed as follows: Let ip (s, x; z) be the offspring 
generating function at time s and point x 



ip{s,x;z) = c^pnis,x)z''' 



(18) 



where Yin Pn = ^ and c denotes the branching intensity. 
Then for e-"'^^'^) = Pc^e"^^'^'?) one has 



+ / dske ^"lp {s,^s] e 
Jo 



) 

(19)" 

The measure-valued process starts from 6^ at time 0, r is the first exit time 
from Q and / (r, ^r) the value of a function in the boundary dQ. 

Using ke'^'^ds = 1 — e'~^'^ and the Markov property no,xls<rns,5^ = 
^o,x^s<T, Eg. fin?]) for e~"'(°''^) is converted into 



(20) 



This is lemma 1.2 in ch.4 of Ref. [5]. Because of the central role of this result 
for the construction of superprocesses, a proof is included in the Appendix 
with the notations used in this paper. 

Eq.(2.11) is now obtained by a limiting process. Let in fl20p replace 
w{0,x) by f3wj3{0,x) and / by f3f. f3 is interpreted as the mass of the 
particles and when the measure- valued process Xq — )■ /5Xq then Pfj, ^ Pe. 



0,2: 



(21) 
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Defining 

up=[l-e-^-^)/P ; f^ = {l-e-Pf)/^ (22) 



and 



k 

ipH (r, X] Up) = ^ (V^ a;; 1 - I3up) - 1 + (23) 



one obtains from (l^T]) 

(0, x) + no,a; / cis?/;^ (s, is] Up) = Uo^xff} {r, (24) 
Jo 

tliat is 

Up + Gqijp (up) = KqJp (25) 

Wlien /3 — )■ 0, f ^ fp and if ^/'/j goes to a well defined limit tlien up tends 
to a limit u solution of (|T5l) associated to a superprocess. Also one sees from 
fl22|) that in the /3 ^ limit 

W/3^w^/3 = -logPo,xe-<-^'^'5) (26) 

as in Eq. (fT4|) . The superprocess corresponds to a cloud of particles for which 
both the mass and the lifetime tend to zero. 



2.3 The KPP equation as a superprocess 

When the integral Eq. ([7]) is interpreted probabihstically, it may be identified 
with Eq.([l9]) with k = 1, e-'"^^'^) = v (r, x), e-^(^'«-) = g (^^), if (s, e-'"(^-"'«=)) = 

(r — s,is)- Therefore the McKean probabilistic construction corresponds 
to an intermediate step in the superprocess construction. At this level the 
process that is considered in Eq. (fT9|) is the same as in McKean's construction. 
Summing over the exit measure, the solution is 

V {t,x) = e"(^'^«) = e-^'^(^^') = e^«'°s3(^->) = Uig (^.J (27) 

essentially the same as in ([H]). However, there are two differences. First, the 
initial condition g must be positive to have a well-defined logarithm. This is 
a restriction as compared to McKean's construction. But, on the other hand, 
the interpretation as an exit measure, allows to deal with Cauchy problems 
with boundary conditions. The exit measure is from the set Q = [0, t] x Q, 
T being the time at which the (t, ^t) process reaches dQ or r = t inside fl. 
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For the superprocess, let u(t,x) = 1 — v {t, x), which satisfies the equation 

du 1 d'^u 



dt 2dx^ 

and the integral equation 



+ u (28) 



u (t, x) = G (t, x) (1 — g (x)) + j G {s, x) (u {t — s,x) — {t — s, x)) ds 

(29) 



or 



u 



(t, x) + [ {u^ it - s, Q -u{t-s, ds = U^{l-g (6)) (30) 
Jo 



that is for KPP 

{0,x;u) = — u (31) 
Equating with ([23]) one obtains 

k 

ippiO^x^up) = {(p{0,x;l - l3u^) - 1 + (3ui3) 

= ^(c$^Pn(l-/3«/3)"-l + /3«;3) 

= u^-u (32) 



with pn = Sn,2- Therefore c = /3 = 1 and fc/j = 1. That is, for KPP the 
superprocess is not a scaling limit. It coincides with the McKean process. 
However in this case, because (3 = 1 instead of /3 ^ 0, the solution is given 
by (1 - e"'") instead of (fill). 

However, the power of the superprocesses is that, with other limiting 
choices of (3, stochastic solutions may be constructed for other equations, in 
particular for solutions without the natural Poisson clock provided by the 
term —v which is present in the KPP equation. For example for 

¥ = 25^^ + " 

with u = —V 
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one has 

i;{0,x;u) = u^ (35) 

which equated with (123|) 

^ / 2 

'iljfs{0,x;u^) = - 1 + +Pi (1 - /3m/3) +P2 (1 - /3m/3)' 

= 4 (36) 

leads to 

1 2 

Pi = 0; Po = P2 = = ^ (37) 

In this case one may let /3 — )■ 0, the solution is given by f|T4|) and the super- 
process corresponds to the scaling limit (n — )■ cxd in Fig. 2) of a process where 
both the mass and the lifetime of the particles tends to zero and at each 
bifurcation point one has equal probability of either dying without offspring 
or having two children (Fig. 2) 

This construction may be generalized for interactions with 1 < a < 2. 
With z = 1 — f3up one has 

Choosing fc^ = the terms in z cancel and for 1 < a < 2 the coefficients of 
all the remaining z powers are positive and may be interpreted as branching 
probabilities. It would not be so for a > 2. Then 

Po = -; Pi = 0; ■■■ Pn = ^^f") n>2 (39) 

with J2nPn = 1- With this choice of branching probabilities, kp = -j^^ and 
/3 — 7- one obtains a superprocess which, through (ITll) . provides a solution 
to the equation 

for 1 < a < 2. 

However, the superprocess cannot be constructed for a > 2 because some 
of the coefficients in the offspring generating function ip (0, x; z) would be 
negative. 
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Figure 2: The branching process which in the scahng hmit n — oo leads to 
the superprocess solution of Eq. flMj) 



3 Appendix: Proof of the lemma 

Let ^ 

u (x, t) = Ho,. |e-'=*M (6, 0) + ^ ke-^'^ fc, t - s) ds^ (41) 

Then 

(42) 
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Summing (gl]) and 

u (x, t) + Hq^x / ku (^s, t — s)ds 
Jo 

= Ho,. I (^e-'=* + ^ ke-'^'-'Us^ u (6, 0) 

+A; f e''''^{^s,t- s)ds + k f ds f kda'c"^'' ^ {^s+s'^t - s - s') ds'X 
Jo Jo Jo ) 



(43) 



Changing variables in the last integral in fH3|) from (s, s') to (s, o" = s + s') 
one obtains for the last term 

k [ da [ kdse-''^"-'^^{i^,t-(j)ds 
Jo Jo 

and finally 

u{x,t) + I\.Q^xk / u{^s,'t — s)ds 
Jo 

= Ho,. |m (6, 0) + ^ ^ ^ - ^) (44) 
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